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Abstract 

The results on the fluxes of charged particles and neutrinos from a 3-dimensional 
J> | (3D) simulation of atmospheric showers are presented. An agreement of calculated 

fluxes with data on charged particles from the AMS and CAPRICE detectors is 
demonstrated. Predictions on neutrino fluxes at different experimental sites are 
CO ' compared with results from other calculations. 
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Jl • 1 Introduction 

a: 

^| The interpretation of the data on atmospheric neutrinos from different experiments 

relies on calculations of neutrino fluxes. The many calculations made in recent years 
jH El El HI El El EDI HH H2] have been done using approaches invoking different models of 
the Earth's magnetic field, different primary spectra of cosmic rays and methods of tracing 
them in the Earth's magnetic field, as well as various models of production of secondaries 
in the inelastic interactions and the way the Earth's magnetic field is influencing (or not) 
the propagation of these secondaries in the atmosphere. (For a review see [13 J. 

In view of fundamental importance of results of calculations for the interpretations of 
the atmospheric neutrino anomaly, it is acknowledged that a comprehensive simulation 
of atmospheric showers is needed. However, because of big computing power required to 
perform this task, most calculations resort to some, presumably well argumented simpli- 
fications. In the previous work ^Oj 1 an attempt has been made to avoid these simplifica- 
tions. The calculations were based on the recent data from the AMS experiment JH] and 
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demonstrated a good agreement with experimental results in terms of fluxes of charged 
secondaries produced in atmospheric showers [TH I15j. 

The present study follows the same approach with some changes. Firstly, the rigidity 
range of generated primary cosmic rays is extended from 100 to 500 GV. Secondly, the 
contribution from helium nuclei is simulated directly in He interactions with atmosphere 
and not using the results from proton interactions. Finally, the statistics of this study is 
about 3.5 times bigger and corresponds to ~ 2.2 ps exposure. 

2 Description of the model 

The calculation is based on the GEANT3/GHEISHA package ^H] adapted to the scale 
of cosmic ray travel and interactions. The Earth is modeled to be a sphere of 6378.14 km 
radius of a uniform density of 5.22 g/ cm 3 . The atomic and nuclear properties of the Earth 
are taken to be those of Ge - the closest in density (5.32 g/cm 3 ) element. The Earth's 
atmosphere is modeled by 1 km thick variable density layers of air extending up to 71 km 
from the Earth's surface. The density change with altitude is calculated using Standard 
Atmosphere Calculator ^7j. The Earth's magnetic field for the year 1998 is calculated 
according to World Magnetic Field Model (WMM-2000) [THJ with 6 degrees of spherical 
harmonics. 

The flux of primary protons and helium nuclei in the Solar system is parametrized 
on the basis of the AMS data ^3]. At the rigidities below several GV the spectrum is 
corrected for the solar activity according to the 11 year solar cycle ^Hj- Isotropically 
emitted from a sphere of 10 Earth's radii, the primary cosmic particles with kinematic 
parameters compatible with those reaching the Earth are traced in the magnetic field 
until they interact with the atmosphere. The production of secondaries resulting from 
interactions of He nuclei is treated using the superposition approximation j20j. The 
leading primary and the secondary particles produced in the interactions are traced in 
the magnetic field until they go below 0.125 GeV/c. 

3 Comparison with experimental data 

All results in this study are obtained directly without any renormalization. To compare 
the calculated fluxes of charged particles with the AMS measurements [T3| the overall 
fluxes produced in the simulation are restricted to the AMS acceptance during the zenith 
facing flight period. FigQ shows the spectra of protons for different positions of AMS 
with respect to the magnetic equator. As in the previous study the result of simulation 
correctly reproduces the spectra of both primary and secondary protons. 
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Protons in AMS 
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Figure 1: Proton flux in AMS at different magnetic latitudes (|6m|)- Solid line - flux 
from the top, dashed line - flux from the bottom, a) |©m| <0.2 rad, b) 0.2< |0m| <0.5 
rad, c) 0.5< |Oj\/| <0.8 rad, c) 0.8< |0a/| <1-1 rad. The dots are the AMS measurements 
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Positron flux in AMS 





Figure 2: Secondary positron flux in AMS at different magnetic latitudes (|0m|)- Solid 
line - flux from the top, dashed line - flux from the bottom, a) |©m| <0.3 rad, b) 
0.3< \e M \ <0.6 rad, c) 0.6< \<d M \ <0.8 rad, c) 0.8< \Q M \ <1.1 rad. The dots are the 
AMS measurements |Hj. The enhancement at higher energies of the measured flux at 
high magnetic latitude is due to primary cosmic positrons detected in the lower magnetic 
cutoff region. 
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Electron flux in AMS 




Figure 3: Secondary electron flux in AMS at different magnetic latitudes (|Oa/|). Solid 
line - flux from the top, dashed line - flux from the bottom, a) \Qm\ <0.3 rad, b) 
0.3< \e M \ <0.6 rad, c) 0.6< |9 M | <0.8 rad, d) 0.8< \Q M \ <1.1 rad. The dots are the 
AMS measurements |Hj. The enhancement at higher energies of the measured flux at 
high magnetic latitude is due to primary cosmic electrons detected in the lower magnetic 
cutoff region. 
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Positron/electron flux ratio in AMS 
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Figure 4: Calculated dependence on magnetic latitude of positron/electron flux ratio. 
The dots are the AMS measurements 
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Vertical muons at the sea level 
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Figure 5: Vertical muon flux at the sea level. Histogram: this study. Circles: data from 
CAPRICE 94 
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The simulated positron and electron spectra shown in Figs|21 and El are in good agree- 
ment with those obtained in the AMS experiment ^3] allowing for still insufficient statis- 
tics of spiraling positrons and electrons in the equator region, where the spiraling sec- 
ondaries dominate. For detailed discussion of the behaviour of the secondaries see ^U] ■ 
The measured relative rate of secondary leptons and their dependence on the magnetic 
latitude is well reproduced by the simulation (FigHJ. 

The histogram in FigJ3] shows the flux of cosmic muons within the acceptance of the 
CAPRICE 94 experiment. The calculated flux is in good agreement with the measured 
one reported in [2Tj . 

A good agreement between the predictions of fluxes of charged secondaries provided by 
this calculation and the measurements is a strong indication that the fluxes of neutrino, 
which are produced in the same decays as the charged particles (see Fig lTT)|l are simulated 
correctly. 

4 Atmospheric neutrino fluxes 

FigsEEIEl show the angular distributions of neutrino event rate in different regions ac- 
cording to the geomagnetic latitude calculated using the neutrino fluxes obtained in this 
work. These distributions are the result of convolution of neutrino fluxes with the neu- 
trino cross sections [221,123,1211 and do not include detector related effects. The actual 
amount of detected neutrinos from those produced just under the Earth's surface, which is 
modeled as a simple sphere, depends on the actual detector position (depth underground, 
surrounding landscape). Compared to .Sj the event rates from this work, given in Figs l6J7l 
for the magnetic latitude region with sin(BM)= [0.2,0.6], are systematically higher for 
very low, E^O. 1-0.31 GeV, energy neutrinos, and are similar in the energy range of 
E„=0. 31-1.0 GeV. For higher energies of E^=l. 0-3.1 GeV this work predicts event rates 
which are at the level of 0.7-0.8 of the 3D calculation result of |H]. The important differ- 
ence with previous calculations is clearly visible in the highest neutrino energy range of 
£^=3.1-10.0 GeV. On the one hand the angular distributions and the absolute event rates 
for e-like events are practically the same for all types of calculations. On the other hand 
the integral event rate for ^u-like events is only about 0.6 of those predicted in jH] and the 
angular distribution of this events, apart form the angular region close to the horizontal 
direction, is much flatter. This tendency is typical for high energy neutrino events at all 
magnetic latitude regions (see FigJHJ). 

The neutrino flux at different experimental sites is calculated for the area ±12° in lati- 
tude and longitude with the center at (35° N, U2°E); (48° N, 98° W) and (42° N, 13° E) 
and the depth underground of 520 (2700 mwe), 700 and 750 m for Kamioka, Soudan and 
Gran Sasso sites correspondingly. Fig|U] shows the averaged over all directions differential 
energy spectra of different neutrinos and antineutrinos at the Kamioka site. The spectra 
for Soudan and Gran Sasso sites are presented in FigsEl and ^2 correspondingly. 
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Figure 6: Average nadir angle distribution for e-like events for detectors located in po- 
sitions on the Earth with magnetic latitude sin(6M)= [0.2,0.6]. a) Ej,=0. 1-0.31 GeV, b) 
E^=0.31-1.0 GeV, c) E„=1.0-3.1 GeV, d) E„=3. 1-10.0 GeV. From Ref.0 : dashed line - 
ID calculation without geomagnetic effects; dotted line - ID calculation; dash-dotted line 
- 3D calculation. Solid line -this work. 
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Figure 7: Average nadir angle distribution for /i-like events for detectors located in po- 
sitions on the Earth with magnetic latitude sin(6M)= [0.2,0.6]. a) Ej,=0. 1-0.31 GeV, b) 
E^=0.31-1.0 GeV, c) E„=1.0-3.1 GeV, d) E„=3. 1-10.0 GeV. From Ref.0 : dashed line - 
ID calculation without geomagnetic effects; dotted line - ID calculation; dash-dotted line 
- 3D calculation. Solid line -this work. 
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Figure 8: Average nadir angle distribution for e-like and jU-like events induced by neutrinos 
with energy Ej,=3. 1-10.0 GeV. For detectors located in positions on the Earth with mag- 
netic latitude: top - equator region, sui(0m)= [-0.2,0.2]; bottom - polar region, sin(0M) = 
[0.6,1.0]. From Ref.jB] : dashed line - ID calculation without geomagnetic effects; dotted 
line - ID calculation; dash-dotted line - 3D calculation. Solid line -this work. 
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Figure 9: Differential energy spectra of atmospheric neutrino (averaged over all directions) 
at the Kamioka site, a) u e , b) v e , c) d) v^. Asterisks from Ref. [7j, open circles from 
Ref. pj, triangles from Ref. stars from Ref.jH]. Histograms - this work. 
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Neutrinos at the Soudan site 




Figure 10: Differential energy spectra of atmospheric neutrino (averaged over all direc- 
tions) at the Soudan site, a) u e , b) u e , c) d) v^. Squares from Ref. [7j, dots from 
Ref.jHj, triangles from Ref.jEJ. Histograms - this work. 
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Neutrinos at the Gran Sasso site 




Figure 11: Differential energy spectra of atmospheric neutrino (averaged over all direc- 
tions) at the Gran Sasso site, a) v e , b) v e c) u^, d) v^. Dots from Ref.[5]. Histograms - 
this work. 
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Figure 12: Neutrino flux at different sites. Left - Kamioka, center - Soudan, right -Gran 
Sasso. Top: East/West distribution. Zero corresponds to the flux from the West, 
-solid line, P M - dashed lilne, v e - dotted line, v e - dash-dotted line. Middle: Down/Up 
flux ratio. u^+P^ -solid line, u e + v e -dashed line. Bottom: i^+P M /^ e + flux ratio. 
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Figure 13: Angular dependence of neutrino flux at different sites. Top - Kamioka, middle 
- Soudan, bottom - Gran Sasso. Left column - u e + v e , right column - i^+P^. Neutrino 
energy: Dotted line - 0.1< E v <0.31 GeV; dashed line - 0.31< E„ <1.0 GeV; solid line - 
E u >1.0 GeV. 



16 



2.5 
2 
1 .5 



-1 








Figure 14: Angular dependence of v^+v^ / v e +v e flux ratio at different sites. Neutrino 
energy: left column 0.1< E v <0.31 GeV; central column 0.31< E v <1.0 GeV; right 
column E v >1.0 GeV. Top raw - Kamioka site; middle raw - Soudan site; bottom raw - 
Gran Sasso site. The error bars give statistical errors. 
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In comparison with predictions of previous calculations made for this sites |3 13 El 
there is an excess of low energy and a deficit of high energy neutrinos. The same tendency 
is reported in [H]. The extent of these differences depends on the given site and is not 
the same for different kinds of neutrino. 

From FigEl one can see that there is a considerable difference both in East/West 
and down/up asymmetry of the fluxes at different sites. At the same time the ratio of 
muon(^ + Dfj) to electron(z/ e + P e ) neutrino fluxes, dominated by low energy neutrinos, 
appears to be constant at all sites and independent on the direction of neutrinos with 
respect to the surface of the Earth. The situation is much different if one considers 
different neutrino energy intervals (Fig llHj) . As it is shown in Fig^^the muon/electron 
neutrino flux ratio is constant only for low energy neutrinos. With the increase of neutrino 
energy the ratio behaves differently at different sites, although there is a clear tendency 
towards smaller values of muon/electron neutrino flux ratio for directions approaching 
horizontal. This effect, reported in our previous work ^Uj is confirmed by the present 
higher statistics calculations. 

5 Discussion 

The neutrino fluxes predicted in this work for different locations have the energy spectra, 
relative intensity and angular distributions different from those obtained by other authors. 
There are several points in calculations which can explain these differences. 

5.1 Primary cosmic ray flux 

It is recognized, that the primary cosmic ray spectrum is a major source of uncertainty 
in calculations of atmospheric neutrino fluxes. As it was demonstrated in section 3, the 
primary proton flux calculated using the forward tracing method fits well the AMS data. 
In this section we present the results on primary proton flux at different magnetic latitudes 
obtained using the backward tracing method commonly used as a standard procedure in 
atmospheric neutrino flux calculations. In this study the protons with the interstellar 
rigidity spectra are isotropically emitted from a sphere situated at the the top of the 
atmosphere at 70 km from the Earth's surface and are traced following the backward 
path of a particle with the same rigidity but of the opposite charge. Only particles back- 
traced to a large distance (10 Earth's radii) are considered as following an "allowed" 
trajectory. 

The flux of primary protons with "allowed" trajectories passing through a detection 
plane from the top hemisphere is shown in FigEHfor different magnetic latitude regions. 
The detection sphere is assumed to be at 400 km, corresponding to the AMS flight altitude. 
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Figure 15: Proton flux in AMS at different magnetic latitudes (|Ojvf|). Solid line - back 
tracing, dashed line - forward tracing, a) |©m| <0.2 rad, b) 0.2< |Oa/| <0.5 rad, c) 
0.5< |©m| <0.8 rad, c) 0.8< \Qm\ <1.1 rad. The dots are the AMS measurements [Hj. 
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A comparison with AMS measurements (see Fig|T3j) shows that the cutoff value at 
different magnetic latitudes is predicted correctly for both backward and forward tracing. 
However, at variance with predictions obtained with forward tracing, the flux of "allowed" 
backtraced protons approaches the measured values only above 40 GeV and is far below 
elsewhere . For protons responsible for production of low energy neutrinos it is about 2 
times less then in the experiment. This deficit in primary flux intensity could be a reason 
for the lower fluxes and, consequently event rates, predicted for low energy neutrinos in 
previous calculations as compared with the present one. 
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Figure 16: Atmospheric neutrino production mechanism. 



5.2 fi/e event rato for high energy neutrinos 

There is a qualitative explanation of the /i event suppression at high energy resulting from 
this study. The production of neutrinos in atmospheric showers is illustrated in Figllfil 
Charged pions produced through inelastic interactions of primary cosmic radiation decay 
as follows: 

7T+ — > fl + + 

e + + v e + 

7T~ -> + 
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Due to the Earth's magnetic field a charged particle is deflected before decay from its 
initial direction. The deflection, AG, is practically independent of the particle momentum, 
P, 



L 7 i/p 2 + m 2 const 

AO = — ~ — = ~ , 

R p mp m 

where L is the decay path length and R is the radius of curvature of the particle track in 
the magnetic field. 

For pions the mean decay length is short (cr 7r =7.8 m) and, consequently, the mean 
deflection is very small (AO,,- ~ 0.4 mrad). For muons the mean decay length is about 
100 times longer (cr /J =658.6 m) resulting in a mean muon deflection before decay, AO M ~ 
3°. Albeit relatively small, this deflection is sufficient to direct most of neutrinos from 
atmospheric muon decays towards the ground, even allowing for the Earth's spherical 
shape. 

Thus, the neutrinos from n + — > y^Vp, and 7r~ — > /i~f> M decays of pions produced 
in the atmosphere and going nearly parallel to horizon never reach the surface of the 
Earth. On the other hand (a half of) neutrinos from muon decays are emitted towards 
the Earth. Assuming equal flux from the East and the West, which is the case for high 
energy neutrinos produced by high energy cosmic rays, one gets for the nearly horizontal 
flux: and v e from the West and and v e from the East (see FigIT6|l. and for the muon 
to electron event ratio: 

V = + v» = x 
e v e + i> e 

All neutrinos from the vertical direction reach the Earth's surface. This gives for the 
event ratio: 

» = K + ^) + + = 2 
e z7 e + v e 

in agreement with results of the present calculations. 



5.3 Hadronic interaction models 

Different groups use different models to simulate production of secondaries in the atmo- 
spheric showers. Independent of the method used, all models are eventually fine tuned 
using as much available experimental data as possible. The GHEISHA code of simulation 
of hadronic interactions used in this study is not an exception. 

There is a certain amount of criticism of GHEISHA in connection with neutrino flux 
calculations [HJ U21 12H] based on direct model tests presented in j23 EH] • 

The inability of GHEISHA to predict the properties of residual nuclear fragments 
and the related problems with momentum/energy conservation may be of importance 
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in calorimetry, but have no pertinence to the secondaries responsible for production of 
charged leptons and neutrinos in the energy range considered in this study. 

The results of j^Zj are relevant for proton interactions with relatively heavy (A>27) 
nuclei at proton energies Ej a b <1 GeV i.e. the region of energies too low to affect atmo- 
spheric neutrino fluxes. 

In j2H] the interactions of pions with several nuclei are studied. It is acknowledged 
that as far as secondary pion multiplicity and Feynman x distributions are concerned 
GHEISHA behaves well up to the pion energies as high as 100 GeV. At the same time 
there are some deviations from experimental data, especially for heavy nuclei, in transverse 
momenta and rapidity distributions of the secondaries. These deviations can not seriously 
influence the results of atmospheric shower simulations. 

An atmospheric shower is developing in the medium of rapidly changing density. A 
particle arriving vertically with respect to the Earth's surface pass through an equiva- 
lent of one nuclear interaction length when it reaches an altitude of about 17 km. The 
equivalent of second interaction length is attained at about 13 km. At these altitudes the 
density of atmosphere is 1/10 and 1/5 of air density at the ground level respectively. This 
corresponds to nuclear interaction length of about 13 km and 3.5 km respectively. A pion 
of energy as high as 20 GeV has a mean decay length of only about 1 km. Consequently, 
charged pions produced in atmospheric showers mostly decay in flight and do not interact 
with atmosphere. For the neutrino fluxes, it means that the effect of inaccuracy in angular 
distributions of secondary pions reported in [2Bj is washed out by the change in direction 
of pions in the Earth's magnetic field and the subsequent pion decay. 

6 Conclusions 

Our calculations are based on the up-to-date data on the cosmic ray fluxes measured by the 
AMS detector The atmospheric showers are simulated with as little simplifications 
as possible at all stages of primary and secondary particle travel and interaction with the 
atmosphere. The difference in angular distributions of the ratios of fluxes of different kinds 
of neutrino at different sites and their dependence on the neutrino energy reported in ^0] 
is confirmed on the basis of higher statistics. The angular distributions and the neutrino 
event rates obtained in this study suggest a possibility to describe the experimental results 
on the high energy atmospheric neutrino fluxes [21 0] without evoking muon neutrino 
oscillations. 

The good agreement between charged secondary particle spectra produced in this cal- 
culation and experimental data from AMS ^3] and CAPRICE [23] supports the viability 
of the result on atmospheric neutrino fluxes. 

Acknowlegements. I'm grateful to Prof.Yu.Galaktionov for very useful and stimu- 
lating discussions. 
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